Measurement Invariance Research Articles

Psychometric Properties of the Thai Gaming Disorder Test (GDT) and Thai Gaming Disorder Scale for Adolescents (GADIS-A)

ABSTRACT The present study examined psychometric properties of the Gaming Disorder Test (GDT) and Gaming Disorder Scale for Adolescents (GADIS-A), among Thai university students. A convenience sample of university students (n = 612) completed an online survey. . A one-factor structure for GDT, and a two-factor structure for GADIS-A were confirmed . Omega coefficients for both scales were acceptable. . There were positive significant associations between the assessed scales and other related measures indicating convergent validity. Appropriate fit indices were found (across gender and daily time spent gaming supporting measurement invariance. The GDT and GADIS-A are appropriate instruments to assess gaming disorders among Thai university students. .

The ethos brief index-validation of a brief questionnaire to evaluate wellness based on a holistic perspective in patients with restless legs syndrome.

The aim of this study was to validate the Ethos Brief Index (EBI) in patients with Restless Legs Syndrome (RLS). A cross-sectional design, including 788 subjects with RLS (65% women, 70.8 years, SD 11.3) from the Swedish RLS Association, was used. A postal survey was sent out to collect data regarding socio demographics, comorbidities, and RLS-related treatment data. Questionnaires included were EBI, the Restless Legs Syndrome-6 Scale (RLS-6), Restless Legs Syndrome-Quality of Life questionnaire (RLSQoL), the Insomnia Severity Index (ISI), and the Epworth Sleepiness Scale (ESS). The validity and reliability of the EBI were investigated using Rasch and confirmatory factor analysis (CFA) models. Measurement invariance, unidimensionality, and differential item functioning (DIF) across age and gender groups, as well as insomnia, daytime sleepiness, RLS-related QoL and RLS severity were assessed. The results supported the unidimensionality of the EBI in the CFA (i.e., explaining 61.5% of the variance) and the Rasch model. The reliability of the EBI was confirmed using composite reliability and Cronbach's alpha. No DIF was identified for gender, age, insomnia, daytime sleepiness, RLS severity or RLS-related QoL. The EBI showed good validity and reliability and operated equivalently for male and female patients with RLS. Accordingly, healthcare professionals can use the EBI as a psychometrically sound tool to explore and identify patient-centered problems related to the whole life situation.

Measurement Invariance of the Fear of Happiness Scale in Adults Samples From Six Countries

Measurement Invariance of the Fear of Happiness Scale in Adults Samples From Six Countries

A Measurement Invariance Analysis of the Anxiety Scale for Autism-Adults in a Sample of Autistic and Non-Autistic Men and Women.

The Anxiety Scale for Autism-Adults (ASA-A) captures the autistic anxiety experience, but we do not know whether it is structurally equivalent for men and women, or non-autistic people. Measurement invariance analysis considered gender and diagnostic status (342 cis-gender autistic men (N = 105) and women (N = 237), 316 cis-gender non-autistic men (N = 104) and women (N = 212)). Strict invariance was achieved between autistic men and women and between non-autistic men and women, but the ASA-A structure is quantitatively different in autistic compared to non-autistic adults. Therefore, this tool cannot be used to directly compare anxiety between these groups. Autistic women scored significantly higher on the ASA-A than autistic men and Uncertainty was the highest scoring factor for autistic participants. Future research should include alternative gender identities.

The Psychometric Properties and Measurement Invariance of the Academic Grit Scale (AGS) in Chinese Adolescents

The Psychometric Properties and Measurement Invariance of the Academic Grit Scale (AGS) in Chinese Adolescents

Spanish and Catalan Versions of the eHealth Literacy Questionnaire: Translation, Cross-Cultural Adaptation, and Validation Study.

The rise of digital health services, especially following the outbreak of COVID-19, has led to a need for health literacy policies that respond to people's needs.Spain is a country with a highly developed digital health infrastructure, but there are currently no tools available to measure digital health literacy fully. A well-thought-through questionnaire with strong psychometric properties such as the eHealth Literacy Questionnaire (eHLQ) is important to assess people's eHealth literacy levels, especially in the context of a fast-growing field such as digital health. This study aims to adapt the eHLQ and gather evidence of its psychometric quality in 2 of Spain's official languages: Spanish and Catalan. A systematic cultural adaptation process was followed. Data from Spanish-speaking (n=400) and Catalan-speaking (n=400) people were collected. Confirmatory factor analysis was used to confirm the previously established factor structure. For reliability, the Cronbach α and categorical ω were obtained for every subscale. Evidence of convergent and discriminant validity was provided through the correlation with the total score of the eHealth Literacy Scale. Evidence based on relations to other variables was evaluated by examining extreme values for educational level, socioeconomic level, and use of technology variables. Regarding the confirmatory factor analysis, the 7-factor correlated model and the 7 one-factor models had adequate goodness-of-fit indexes for both Spanish and Catalan. Moreover, measurement invariance was established between the Spanish and Catalan versions. Reliability estimates were considered adequate as all the scales in both versions had values of >0.80. For convergent and discriminant validity evidence, the eHealth Literacy Scale showed moderate correlation with eHLQ scales in both versions (Spanish: range 0.57-0.76 and P<.001; Catalan: range 0.41-0.64 and P<.001). According to the relationship with external variables, all the eHLQ scales in both languages could discriminate between the maximum and minimum categories in level of education, socioeconomic level, and level of technology use. The Spanish and Catalan versions of the eHLQ appear to be psychometrically sound questionnaires for assessing digital health literacy. They could both be useful tools in Spain and Catalonia for researchers, policy makers, and health service managers to explore people's needs, skills, and competencies and provide interesting insights into their interactions and engagement regarding their own experiences with digital health services, especially in the context of digital health growth in Spain.

Stockholm Syndrome and Gender-Related Ideologies and Attitudes: A Psychometric Assessment

Stockholm syndrome, a paradoxical phenomenon, characteristic of the particular psychological functioning of people in captivity and victims of mistreatment, sexual abuse and gender-based violence, arouses significant interest in psychological sciences. However, the related instrumentation remains limited, due to the fact that there is not a significant number of measurements that can evaluate it. In addition, the current main measure (the &amp;lt;i&amp;gt;scale for identifying “Stockholm Syndrome” reactions in young dating women/Escala para identificar reacciones de síndrome de Estocolmo (SISSR) relacionada con violencia de pareja&amp;lt;/i&amp;gt;), only exists in the English and Spanish languages; which constitutes a linguistic obstacle for its administration to individuals who speak other languages, such as French. However, the simple translation of the items of a measurement does not guarantee its reliability from a psychometric point of view. In this vein, this study proposes the translation in French and validation of the Spanish version of this measure. It also proposes, as part of testing the predictive validity of the measure, to link the construct of Stockholm syndrome with gender-related ideologies and attitudes. The validation of the French version of the Stockholm syndrome measurement scale was carried out with two samples (N = 836) consisting entirely of women. The exploratory test (EFA) carried out with 400 participants reveals a reliable tri-factorial structure of 16 elements, after the elimination of 33 elements, due to factor loadings lower than .40. The confirmatory analysis of this factorial structure, using the Structural Equation Method (CFA-SEM), carried out on a sample of 436 participants, supports the tri-factorial structure which fits the data better. Tests of factorial invariance of the measurement, depending on marital status (n1 = 215 married women; n2 = 221 concubine) reveal a structural equivalence between the groups. The predictive validity of the measure reveals that Stockholm syndrome is linked to attitudes towards gender-based violence, sexism, feminism, non-justification of the gender system and gender-based social dominance.

Approaching Temporal Dynamics in the Dimension-Level Associations Between Career Adaptability/Ambivalence and Internalizing Symptoms Among Chinese Adolescents Throughout Their High Middle School Years.

Despite the well-established associations between adolescents' internalizing symptoms and career development, it still remains unclear whether adolescents' internalizing symptoms are precursors or consequences of their career adaptability/ambivalence. Subtler nuance inherent within such association also await to be revealed, because internalizing symptoms and career development have been primarily treated as broad constructs, despite the multifaceted nature of both. To narrow such gaps, this study examined the potentially dynamic associations among career adaptability, career ambivalence, and internalizing symptoms using three-wave longitudinal data. The study collected data from 3196 Chinese adolescents (52.72% girls, mean age = 15.56 years, SD = 0.58) at Wave 1, with 2820 (attrition rate = 11.76%) participating in Wave 2 and 2568 (attrition rate = 8.93%) in Wave 3. The measurement invariance suggested that there were no significant differences across both waves and genders. This study approached associations at both broader construct levels and subtler dimension levels. Results of cross-lagged path models at broader construct levels demonstrated a unidirectional association between internalizing symptoms and career adaptability. Results of models at subtler dimension levels indicated a series of transactional links over time between career adaptability dimensions/ambivalence and depressive symptoms in particular. Career adaptability dimensions and career ambivalence predicted later anxiety symptoms rather than the reverse. Group model comparisons showed no difference across waves and genders. These findings shed light on the dynamic nature of the associations during adolescence between career adaptability/ambivalence and internalizing symptoms, particularly at subtler dimensional levels, which should be considered in relevant clinical and educational practices.

An evaluation of the psychometric properties of the Australian Collaborative Practice Assessment Tool

Objectives This study aimed to validate the Collaborative Practice Assessment Tool (CPAT) in the Australian setting and provide a quality instrument in terms of psychometric properties that can be used to measure interprofessional outcomes for both healthcare practitioners and students. The outcomes evaluated include the capacity to work in an interprofessional team, good interprofessional communication skills, leadership skills, ensuring clear division of tasks and roles in a team, effective conflict management, and being actively involved with patients and their families/communities in care. Methods The COSMIN (COnsensus-based Standards for the selection of health Measurement INstruments) taxonomy and standards were used as guides for evaluating the psychometric properties of the Australian CPAT, which include evaluations regarding instrument development requirements of sample target and size, content validity, internal structure (structural validity, internal consistency reliability and measurement invariance), and hypotheses testing. CPAT Australia was developed through two stages involving pilot studies and a validation study, both of which included healthcare practitioners and students as participants. A pilot study examined content validity regarding item relevance, item comprehensibility, and instrument comprehensiveness. The validation study was carried out to assess the internal structure of CPAT Australia for aspects of structural validity, internal consistency reliabilities, and configural, metric and scalar measurement invariance. The structural validity was explored using the following three steps: exploratory, confirmatory, and multi-group factor analysis. Construct validity was evaluated to confirm direct and indirect paths of assumptions based on a previously validated model. Data collected between August 2021 and May 2022. Results The content validity evaluation confirmed that all items were relevant, understandable and comprehensive for measuring interprofessional collaborative care in Australia. Three hundred ninety-nine participants contributed to the validation study (n=152 practitioners; n=247 students). The original instrument model of 8-Factor 56-Item was improved in the Australian CPAT. Two items, Item 27 (Physicians assume the ultimate responsibility) and Item 49 (Final decision rest with the physician), were consistently rejected and therefore discarded. The internal structure of the 7-Factor 54-Item solution was confirmed as a suitable model with fit indices meeting COSMIN standards for a good model in practitioner and student cohorts. Configural, metric and scalar invariances were confirmed, indicating the invariance of the instruments when used for the practitioner and student cohorts. The construct validity evaluation indicated that 81.3% of direct and indirect assumptions were accepted, fulfilling the COSMIN requirement of &gt;75% of proposed assumptions being accepted. Conclusion The Australian CPAT with a 7-factor 54-item solution was confirmed as a quality measure for assessing interprofessional education and collaborative practice for both healthcare practitioners and students in Australia with robust psychometric properties.

Measurement invariance of the modified Utrecht Homesickness Scale: a case of university students from four countries

Measurement invariance of the modified Utrecht Homesickness Scale: a case of university students from four countries

Supplemental Material for Measurement Invariance of the Child Behavior Checklist (CBCL) Across Race/Ethnicity and Sex in the Adolescent Brain and Cognitive Development (ABCD) Study

Supplemental Material for Measurement Invariance of the Child Behavior Checklist (CBCL) Across Race/Ethnicity and Sex in the Adolescent Brain and Cognitive Development (ABCD) Study

Teacher autonomy support counters declining trend in intrinsic reading motivation across secondary school

AbstractStudents’ intrinsic motivation to read, which is relevant to all forms of learning, tends to decline throughout secondary school. Based on self-determination theory (SDT), this study examines whether this downward trend is slowed when students perceive greater autonomy support in the classroom. We used large-scale panel data from the NEPS comprising N = 8193 students in Germany who reported their intrinsic motivation to read and their perceived autonomy support from German teachers at annual intervals from fifth to eighth grade. Scalar longitudinal measurement invariance was found for intrinsic reading motivation (IRM) and teacher autonomy support (TAS). A dual change score model showed a decline in IRM and a negative, non-significant decrease in TAS over time. Confirming our hypothesis, the decline in IRM was slowed by earlier levels of TAS. We discuss methods to counteract the decline in intrinsic reading motivation.

Gaming disorder test: Assessing psychometric properties, prevalence, temporal stability, and invariance using a Czech two-time-point longitudinal sample

In 2019, Gaming Disorder (GD) was acknowledged as an official diagnosis by the World Health Organization. The Gaming Disorder Test (GDT) is the most widely used tool to measure GD; however, due to its novelty, various measurement properties are still unexplored, and the number of validated language variants is still limited. The present study is the first to assess the psychometric properties of the Czech version of the GDT. Further, it focuses on its temporal prevalence and stability, gaming genre invariance, and criterion validity. A large-scale sample of adult Czech gamers collected at two points within nine months was analysed – T1 N = 5356; T2 N = 6077; longitudinal sample N = 1430. Confirmatory factor analysis (CFA), structural equation modelling (SEM), and multigroup CFA were employed to assess the measurement invariance. The study confirmed the one-factor structure of the GDT and showed that it is invariant across preferred gaming genres and the time of data collection. It showed a negative relationship with life satisfaction and a positive relationship with anxiety, even when controlling for their mutual relationships. The prevalence in the longitudinal sample was equal to or below 1.9% in each wave, but only 0.5% in the longitudinal sample (hence n = 7 participants fulfilled in both waves the criteria for GD). The study suggests that the Czech version of the GDT has good psychometric properties, including temporal stability and invariance across gaming genres, so it is suitable for the survey type and epidemiological investigation of the ICD-11's Gaming Disorder.

Evaluating the measurement invariance of the parenting practices scale in the Caribbean

The purpose of this study was to assess the factor structure and measurement invariance of the three-factor (nurturance, monitoring, discipline) 29-item Parenting Practices Scale across four Caribbean islands—Jamaica, St. Kitts and Nevis, The Bahamas, and St. Vincent and the Grenadines—with data from 1948 adolescent Caribbean grade 10 students. Exploratory factor analysis and confirmatory factor analysis were conducted, and the findings supported the original three-factor model, and factor loading invariance was found across the four Caribbean islands. These findings suggest that this parenting measure may be used to compare perceptions of parental behaviors among adolescents in the English-speaking Caribbean with some limitations that are discussed.

Multidimensional Scale to Assess Digital Security in Adolescents

The study examined the psychometric properties of a Digital Security Scale (DSS-A) in a sample of 868 adolescents (460 female, 408 male), made up of 424 early adolescents (M age = 11.84 years, SD = 0.36) and 444 middle adolescents (M age = 13.44, SD = 0.49). The sample was randomly split into two for validation (n = 434) and cross-validation (n = 434) purposes. The results confirmed the fit of a one second-order factor model with four first-order factors (personal data protection, safe relationships, healthy internet use, and self-disclosure). As expected, digital security dimensions were positively associated with parental mediation. Measurement invariance was found in this model by gender and stage of adolescence. Latent mean comparisons showed differences by gender and stage of adolescence. Overall, findings indicate that the measurement model is helpful for measuring adolescents’ digital security behaviors.

Foreign Language Learning Boredom: Refining its Measurement and Determining its Role in Language Learning

Abstract This cross-sectional and longitudinal study sought to refine the measurement of foreign language learning boredom (FLLB) and examine its links with overall/skill-specific second and foreign language (L2) achievement (curriculum-based course exam scores) and proficiency (Cambridge English test scores). In Substudy 1, we developed and validated an 11-item Foreign Language Learning Boredom Scale–Short Form among secondary and tertiary English as a foreign language (EFL) learners in China (n1 = 2,223, n2 = 504, n3 = 934, n4 = 1,109). The scale showed sound psychometric properties (i.e., construct/criterion/convergent/discriminant/predictive validity, reliability, and measurement invariance across time and groups). In Substudy 2, structural equation modeling results show that FLLB had a consistent modest negative effect on overall and skill-specific (vocabulary and grammar, listening, reading, and writing) L2 achievement and proficiency (n4 = 1,109). Substudy 3 was a 12-month three-semester longitudinal investigation (n4 = 1,109). Cross-lagged panel modeling results show that L2 achievement predicted subsequent FLLB negatively, while FLLB did not predict subsequent L2 achievement.

The Bergen–Social Media Addiction Scale (BSMAS): longitudinal measurement invariance across a two-year interval

ABSTRACT Objective This study aims to examine the longitudinal measurement invariance of the Bergen Social Media Addiction Scale (BSMAS) over a two-year interval, addressing a gap in research on its consistency over time. Method Confirmatory Factor Analysis with a robust maximum likelihood chi-square estimator was utilised to assess the BSMAS among 276 adults (mean age = 31.86 years; SD = 9.94 years; 71% male) at three time points across two years. This method evaluates the scale’s structural consistency and reliability longitudinally. Results The analysis supported full measurement invariance (configural, metric, scalar, and error variance) of the BSMAS, indicating stable measurement properties over time. Furthermore, temporal stability and equivalency of the BSMAS total mean scores were confirmed across the three-time points, suggesting consistent measurement of social media addiction. Conclusions The findings validate the BSMAS as a reliable instrument for measuring social media addiction over extended periods. Demonstrating its psychometric stability enhances its utility for longitudinal studies, making it a valuable tool for tracking changes in social media addiction behaviours. These results have significant implications for future research and clinical practice, highlighting the BSMAS’s applicability in long-term studies.

A cross-cultural examination of the role of enjoyment and passion in bilingual English teachers’ desire for professional development: evidence from Iran and Kuwait

ABSTRACT The present mixed-methods cross-cultural study probed the association between bilingual English teachers’ enjoyment, passion, and desire for professional development from the Iranian and Kuwaiti teachers’ standpoints. In doing so, a random sample of bilingual English teachers (N = 426) was chosen from educational institutions in Iran and Kuwait. Then, using self-report questionnaires and semi-structured interviews, participants’ beliefs and attitudes on the interaction of enjoyment, passion, and desire for professional development were evaluated. The results of confirmatory factor analysis (CFA) exhibited close, positive associations between Iranian and Kuwaiti teachers’ passion, enjoyment, and desire for professional development. Moreover, the results obtained from structural equation modelling (SEM) uncovered that Iranian and Kuwaiti teachers’ enjoyment and passion can positively predict their desire for professional development. However, as the results of measurement invariance revealed, some meaningful differences were found between Iranian and Kuwaiti structural models concerning the predictive role of passion and enjoyment. Additionally, according to the thematic analysis (TA) outcomes, both Iranian and Kuwaiti instructors believed that passion and enjoyment can trigger teachers to attend professional development courses. These findings may contribute to a better understanding of the role of pleasant emotions in language teachers’ motivation for professional advancement.

Capturing students’ LMS experience: measurement invariance across Chinese and English versions

AbstractLearning management systems (LMS) have emerged as a standard component of higher education institutions for the web-based delivery and management of courses. The COVID-19 pandemic highlighted the value of LMS in facilitating online teaching and learning. However, the significance of examining the factors that impact LMS use success during the pandemic has been underestimated. Moreover, despite previous attempts to evaluate students’ LMS experience, most research failed to connect the actual use of LMS to students’ learning success. To address these gaps, we developed and validated an empirical and theory-based instrument measuring students’ LMS experience. The choice of constructs was informed by a scoping review of LMS measures and interviews with a representative sample of students and teachers about their LMS use. By adding constructs that are relevant to learning in the LMS, the current study provided a more comprehensive measurement that captures students’ learning experience in the platform. We provided evidence for the measurement invariance of the scales with their Chinese translation as well. By addressing the limitations and building on this study’s findings, researchers can further advance our understanding of LMS experiences and contribute to developing more effective e-learning systems to support teaching and learning in higher education.

International Trauma Questionnaire and Posttraumatic Cognitions Inventory-9: validity evidence and measurement invariance of their Brazilian versions

BackgroundThe International Trauma Questionnaire (ITQ) is used to measure posttraumatic stress disorder (PTSD) and complex posttraumatic stress disorder (CPTSD) symptoms, and the Posttraumatic Cognitions Inventory-9 (PTCI-9) is used to measure posttraumatic cognitions. Both tools have been translated for use in Brazil. However, the psychometric properties of the Brazilian versions were not investigated, and no study has verified the invariance of these tools for many traumatic event types.ObjectiveThis study examined the validity, reliability, and measurement invariance of the Brazilian versions of the ITQ and the PTCI-9 for trauma type, gender, race, age group, education level, and geographical region.MethodsA total of 2,111 people (67.74% women) participated in an online survey. The scale models were tested via confirmatory factor analyses and measurement invariance through multigroup analyses. Pearson’s correlation analyses were used to examine the relationships between PTSD, CPTSD, posttraumatic cognitions, and depressive symptoms.ResultsExcept for the affective dysregulation factor, the reliabilities of the ITQ and PTCI-9 dimensions were adequate. Models with six correlated dimensions for the ITQ and three correlated dimensions for the PTCI-9 showed adequate fit to the data. The ITQ and PTCI-9 exhibited scalar invariance for gender, race, age group, education level, and geographical region. The ITQ also demonstrated full invariance for trauma type. The factors of both instruments were related to each other and to depressive symptoms, with higher effect sizes for posttraumatic cognitions and complex posttraumatic stress disorder symptoms.ConclusionWe recommend using the Brazilian versions of the ITQ and PTCI-9, which are crucial tools for assessing and treating trauma-related disorders.